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INTRODUCTION 


Presented in this report are the results of data analysis of shuttle-based 
microgravity flight experiments. Potential factors were identified in the previous 
grant period, and in this period 26 factors were selected for data analysis. In this 
project, the degree of success was developed and used as the performance measure. 

293 of the 391 experiments in Lewis Research Center Microgravity Database 
were assigned degrees of success. The frequency analysis and the analysis of 
variance were conducted to determine the significance of the factors that effect the 
experiment success. 



PERFORMANCE INFLUENCING FACTORS 


Thaggard and Morilak (1993) compiled a list of 32 experiment and mission 
specific factors. For this data analysis, 26 factors were included. Modification to 
the original list of factors were made through the course of this study as 
investigators found that some data were unavailable and that some factors were 
redundant. Table 1 .a and 1 .b shows the selected factors and their explanations. 



Table l.a Performance Influencing Factors 
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Active Requires crew involvement or is automated. 

Altitude Requested Altitude requested by principal investigator for optimal 

experiment performance. 

Experiment Location Where the experiments are located during operation on the 

orbiter. 

Experiment Type Type of experiment (ex hardware/instruments, biological). 

Failure Detection Where problem was detected (on-orbiter or post flight). 

Inclination Requested Inclination requested by principal investigator for optimal 

performance. 

Interface Service provided by the orbiter which the experiment 

incorporates into its design. 

Iteration Number of times the experiment has been executed on the orbit. 

Level of Ground Crew An estimate of the number of hours an orbital crew member 

Involvement works with an experiment divided by the experiment’s total 

time of operation. 

Level of Orbital Crew An estimate of the number of hours a ground crew member can 

influence experimental operation divided by the experiment’s 
total time of operation. 

Minimum Time On-Orbit The time the principal investigator felt was needed to run an 

experiment. 

Number of Lockers Number of lockers occupied by the experiment during 

operation. 

Organization Group which developed experiment. 

Storage Location Where the experiment was stored on-orbit prior to operation. 

Type of Orbital Crew Lists specific activities required for experiment operation. 

Involvement 
























Table l.b Performance Influencing Factors 
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Crew Size 

Number of crew members for a particular mission. 

Flight Altitude 

Altitude for a particular mission. 

Flight Duration 

Duration of a particular mission. 

Launch Delay Cause 

Examples: weather, orbiter. 

Launch Delay Duration 

Hours 

Number of Experiments On- 
board 

Number of experiments for a particular mission. 

Orbiter Pad Weather 

Weather at time of launch. 

Time Between Previous Flight 

Time between previous shuttle mission. 

Wait Time on Pad 

Includes loading time and delays 

orbiter 

Examples: Columbia, Challenger 




















PERFORMANCE MEASURE 


The performance measure, the dependent variable, selected in this project 
was the degree of success (DoS) which incorporated many definitions form 
previous studies (Ridenoure, 1986; Winter and Jones, 1992). The scale for DoS 
in Table 2 was based on the following criteria: (1) objectives, (2) results, (3) 
problems encountered and (4) the minimum success requirement, achieving at 
least one objective. 

Based on these criteria, an experiment that achieved the full objective 
without any problems would receive a ranking of “9”. Similarly, an experiment 
that achieved the full objective without any problems, and also obtained data 
beyond the full objective would receive a “10”. On the other hand, an experiment 
that was not attempted at all would receive a “1” or “2” depending on whether 
problems were related to design. An experiment would receive “1” for a design 
problem. Despite the subjective nature of the DoS scale, the numerical definition 
of experimental success offers opportunities for statistical analysis which non- 
continuous, categorical definitions cannot provide. 



Table 2 


Degrees of Success Scale 





Worst 

1,2 

Test not attempted. 


3 

Full objective not achieved. 

Minimum success requirements not achieved. 


4 

Full objective not achieved. 



Minimum success requirements not achieved. 
Some data. 


5 

Full objective not achieved. 

Minimum success requirements obtained. 
Problems encountered. (Related to design.) 


6,7 

Full objective not achieved. 

| 


i 

More than minimum success requirements obtained. 

Problems encountered. (Not related to design.) 


8 

Full objective achieved. 
Problems encountered. 


9 

Full objective achieved. 
No problems. 


10 

Full objective achieved. 

Best 


No problems. 
Additional results. 




STATISTICAL ANALYSIS 


293 of the 391 experiments in Lewis Research Center Microgravity Database 
(LMDB) were assigned DoS rankings. The frequency analysis and the analysis of 
variance were conducted to determine the significance of the factors that effect the 
experiment success. The General Linear Model procedure in SPSS/PC+ Version 
5.0 was used to perform the analysis of variance. Table 3 shows four factors, 
Failure Detection, Active, Altitude Requested and Experimental Type, are 
significant at 0.01 level (99 percent confidence). Three factors, Level of Ground 
Crew Involvement, Minimum Time On-Orbit and Storage Location, are at .05 level 
and Level of Orbital Crew Involvement and Orbiter Pad weather at . 1 level (90 
percent confidence). All interactions between factors are not significant at .05. 

The frequency of each DoS ranking is shown in Table 4 and Figure 1 . 
Approximately 44% of the experiments are ranked 9, and 22% percent are ranked 
“8”. Including the experiments ranked 10, above 70 % of the experiments achieved 
their full objectives. Approximately 8% of the experiments, ranked 1, 2, 3 and 4, 
did not meet their minimum success requirements. 

i 

Tables 5 to 13 and Figures 2 to 10 present the frequency counts and average 
DoS rankings for levels of each significant factor. 



Table 3 


Analysis of Variance Table 


Failure Detection 


Active 


Altitude Requested 


Experiment Type 


Level of Ground Crew Involvement 


Minimum Time On-Orbit 


Storage Location 


Level of Orbital Crew Involvement 


Orbiter Pad Weather 


Launch Delay Cause 


Orbiter 


Wait Time on Pad 


Launch Delay Duration 


Flight Altitude 


Interface 


Time between Previous Flight 


Flight Duration 


Number of Experiments On-Board 


Number of Lockers 


Type of Orbital Crew Involvement 


Experiment Location 


Inclination Requested 


Flight Inclination 


Iteration 


Organization 


Crew Size 



5 


.959 















































































Rankings of DoS 






Table 5 Frequency and Average DoS for Failure Detection 



Problem Detected On-orbit 

66 

Problem Detected Post- 
flight 

62 

Problem Detected On-orbit 
and Post-flight 

8 

No Problems Reported 

138 

Missing 

19 



Table 6 Frequency and Average DoS for Active 


















Frequency and Average DoS for Failure Detection 










Table 7 Frequency and Average DoS for Altitude Requested 



130 km 

5 

8.4 

135 

47 

7.2 

137 

6 

5.8 

— 

150 

3 


160 

13 

8.7 

175 

67 

7.7 

186 

15 

8.2 

190 

27 

8.3 

200 

1 

9.0 ! 

250 

. 

4 

9.3 

| Missing 

105 

7.6 


Table 8 Frequency and Average DoS for Experiment Type 
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| Hardware/Instruments 

16 

7.3 jj 

J Metals/Alloys 

44 

6.9 | 

| Biological 

69 

8.2 

Fluids & Chemicals 

37 

7.6 

Environments 

13 

8.5 

Crystal 

Growth/Crystallography 

33 

7.2 

Astronomy 

17 

7.9 

Photography 

11 

7.9 

Radiation 

13 

8.0 

Other 

40 

7.7 












Frequency and Average DoS for Experiment Types 



Frequency and Average DoS 



Table 9 Frequency and Average DoS for Level of Orbital 
Crew Involvement 





J No Involvement 

85 

7.7 

[ Casual Involvement 

51 

7.3 

Considerable Involvement 

24 

7.5 

Extensive Involvement 

76 

8.0 

Missing 

57 

7.7 


Table 10 Frequency and Average DoS for Level of Ground 
Crew Involvement 
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No Involvement 

173 

7.7 

Casual Involvement 

36 

8.1 

Considerable Involvement 

20 

6.6 

Extensive Involvement 

9 

8.2 

Missing 

55 

7.7 | 





Frequency and Average DoS for Level of Orbital Crew Involvement 
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Frequency and Average DoS 





Frequency and Average DoS for Level of Ground Crew Involvement 
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Table 11 Frequency and Average DoS for Minimum Time 
On-Orbit 



Table 12 Frequency and Average DoS for Storage Location 




Locker 

73 

Rack 

45 

Pallet 

5 

Self-Contained 

58 

Other 

17 

Not Applicable 

11 

Missing 

84 













































Frequency and Average DoS for Minimum Time On-Orbit 
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Frequency and Average DoS 





Frequency and Average DoS for Storage Location 



Frequency and Average DoS 





























Frequency and Average DoS for Pad Weather 



Frequency and Average DoS 






CONCLUSIONS 


This study presents an approach to identify factors that significantly 
influence experiment performance. Investigators developed a Degree of Success 
(Dos)scale to provide a numerical representation of success. Subsequently, a Dos 
ranking was assigned to 293 microgravity flight experiments. 26 factors were 
selected for data analysis. Of these factors, 9 significant factors were identified 
using the analysis of variance. 

This study has used the DoS scale to successfully identify significant 
factors. The future plan for this study is to extend the results of the present data 
analysis by providing an optimal level for each factor and a predictor model of 
experimental performance. This information will enhance the design and 
development of future microgravity flight experiments. 



